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Abstract — This paper studies the quantization of prior proba- 
bilities, drawn from an ensemble, for distributed detection and 
data fusion. Design and performance equivalences between a 
team of agents tied by a fixed fusion rule and a more powerful 
single agent are obtained. Effects of identical quantization and 
diverse quantization are compared. Consideration of perceived 
common risk enables agents using diverse quantizers to collab- 
orate in hypothesis testing, and it is proven that the minimum 
mean Bayes risk error is achieved by diverse quantization. The 
comparison shows that optimal diverse quantization with K cells 
per quantizer performs as well as optimal identical quantization 
with N{K—1) + 1 cells per quantizer. Similar results are obtained 
for maximum Bayes risk error as the distortion criterion. 

Index Terms — Bayesian hypothesis testing, Bregman diver- 
gence, mean Bayes risk minimization, quantization theory, team 
theory 



I. Introduction 

Consider a team of N agents that aims to collaboratively 
choose between hypotheses ho and hi after each agent obtains 
a noisy observation. Local decision-making proceeds in paral- 
lel, with all agents synchronously observing the object, making 
hard decisions locally, and sending decisions to the fusion 
center, without any knowledge of other agents' decisions. The 
fusion center has some fixed fusion rule known to all agents 
that generates a global decision based only on local decisions. 
Fusion rules that are deterministic and symmetric are of the 
i-out-of-A^ form whereby the global choice is hi when L 
or more agents choose hi. Examples are the MAJORITY rule 
(L = r^^l) and the OR rule (L = 1). These arise in 
human affairs, where decision making by juries or committees 
has been analyzed in economics and political science to 
understand rational decision rules when the human decision 
makers possess a common preference for two alternatives |[l]. 

With known prior probabilities for the object state, the 
local decision rules and the fusion rule can be analyzed and 
optimized as standard Bayesian hypothesis testing. Here, we 
consider an ensemble of objects, generally uncountably many. 
Due to limited memory or limited computational resources. 
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agents are only able to distinguish at most K different cate- 
gories of objects (and therefore categories of prior probabil- 
ities). As an example, human decision makers are known to 
think categorically due to the limitation in their information 
processing capacity |2|. Due to categorization, the true prior 
probability of an observed object must be mapped to one of the 
K discriminable values before each agent performs Bayesian 
hypothesis testing. The quality of decisions depends on the 
individuals' categorization schemes. 

In this paper, we study the effect of the categorization and 
optimization of the categorization. Since we limit our attention 
to binary hypothesis testing, a problem from the ensemble is 
specified by a single scalar po — P{H = ho) = 1 — V{H = 
hi). We model po as a realization of a random variable Pq, 
so mapping objects into K categories is equivalent to K-le\el 
quantization of Pq- Quantization performance is measured by 
the quality degradation of decisions made based on the quan- 
tized prior probability, a Bregman divergence called Bayes risk 
error f3\ averaged over Po, which is called mean Bayes risk 
error (MBRE). We consider minimum MBRE quantizers in 
two cases: when all agents use identical quantizers and when 
they use different quantizers. 

A main result of the paper is a large advantage from 
diversity among agents. The traditional advantage of having 
multiple agents in hypothesis testing problems is obtaining 
more observations about objects: agents observe different 
noise realizations and reduce the effects of noise by infor- 
mation aggregation. New here, we show that diversity among 
agents' mapping schemes for prior probabilities can decrease 
the chance that inexact prior probabilities lead to wrong 
decisions. Beneficial diversity helps each agent in cancelling 
others' wrong decisions so that the quality of a global decision 
can be improved on average. Optimal design of the prior- 
probability quantizers enables N agents with different K- 
level quantizers to perform as well as N agents with identical 
{N{K ~ 1) + 1) -level quantizers. 

The precise study of quantization of prior probabilities in 
Bayesian hypothesis testing was recently initiated in |4|, which 
focuses on the minimum MBRE quantizer of a single agent. 
Quantization of prior probabilities to minimize maximum 
Bayes risk is considered in |51. The study of quantization 
of prior probabilities in distributed hypothesis testing by 
three agents appears in |6J, work generalized herein. We use 
a single set of Bayes costs as an element of making the 
agents a team in the sense of Marschak and Radner |[7|, i.e., 
having a common goal. An alternative is for each agent to 
have potentially-different Bayes costs. This introduces game- 
theoretic considerations as described in ||8|. 
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Most previous work on the effect of quantization in 
Bayesian distributed detection is focused on the quantization 
of observations [9J-[1 IJ or the communication topology and 
rates among agents |12| and/or to the fusion center p3) , p4) . 
We do not consider quantization of observations here, though it 
may be noted that quantization outside of the system designer's 
control could be incorporated into the likelihood functions. 

The group decision-making model that we are considering 
is described in Section |ll] In Section [III] we discuss the 
effect of quantization of prior probabilities on decision making 
and compare performances of the teams of agents that use 
identical quantizers and that use different quantizers. Examples 
of optimal quantizers obtained from our design algorithm 



are presented in Section IV In addition to the mean Bayes 
risk error, the maximum Bayes risk error is considered in 
Section [V] Section VI concludes the paper. 



II. Distributed Detection and Data Fusion Model 

A binary hypothesis test for a given object is performed 
by a team of N agents. The object is in state H = ho with 
probability po ™d in state H = hi with probability 1— po- The 
agents have a common goal to minimize the cost due to the 
global decision; the cost for false alarm (misjudgment of h^ 
as hi) is cio and the cost for missed detection (misjudgment 
of hi as ho) is cqi for all agents. For simplicity, we consider 
zero cost for correct decisions. 

The observation by Agent i, Yi, is governed by the like- 
lihood function fYi\H{yi\H = h,n)- Each agent makes a 
hard local decision Hi £ {ho, hi} based on its observation 
and the prior probability it believes. The local decision is 
transferred to a fusion center to be merged with other agents' 
decisions by some fixed fusion rule. We consider symmetric 
fusion rules, which are described as L-out-of-A^ rules for a 
specific 1 < i < A^. This fusion rule returns H ^ hi if at 
least L agents declare hi; otherwise, it returns H = ho- 

Each individual agent makes the two types of errors with 
the following probabilities: 



P' = 



H, = hi\H = ho] , 



= ho \H = hi 



Then, from the L-out-of-A^ fusion rule, the probabilities of the 
global decision being in error are: 



N 



N 
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where [A^] denotes the set {1,2,..., A^}. The Bayes risk is 
based on the team decision: 



R = poCioPl + (1 - Po)coi^'". 



Agent a minimizes its Bayes risk by adopting the following 
likelihood ratio test: 



fy^lHiVa I ho) 
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{Va) = ha 



(4) 
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Consider the special case of agents making observations 
through additive Gaussian noise. That is, being in state hm 
sends a signal Sm G M to all agents, but Agent i receives 
the corrupted signal Yi = Sm + Wi, where the noise Wi is 
assumed to be iid Gaussian with zero mean and variance cr^. 
Then the likelihood ratio test can be simplified to the decision 
rule with a decision threshold Xa- 



Va 



Ha{ya)=hi 

> \ 



By picking the L-out-of-A^ rule as their fusion rule, the 
agents have symmetry in their decision making under iid 
additive noise. All agents have the same likelihood ratio test 
Q, which implies that we can constrain the agents to use 
identical decision rules. 

Limiting attention to identical decision rules considerably 
simplifies the problem. The solution with an identical local 
decision rule constraint is asymptotically optimum for the 
binary hypothesis testing problem fTS) . Furthermore, numer- 
ical experience shows that the constraint results in little or 
no loss of performance for finite A^ and the optimal fusion 
rule has the form of an L-out-of-A^ rule f\3\ . These results 
have been obtained in decentralized detection models in which 
the fusion rule is to be optimized in addition to the local 
decision rules. Our model has a fixed i-out-of-A^ fusion rule 
and only local decision rules are subject to be optimized. 
Numerical experiments show that the restriction to identical 
decision rules leads to no loss of performance for A^ < 5 in 
the Gaussian likelihoods case (see Sections |IV-A and |IV-B[ ) 
and the exponential likelihoods case (see Section IV-C i. Thus, 



(3) 



we constrain the agents to use identical decision rules in the 
discussion ahead. 

III. Quantization of Prior Probabilities 

We replace the classical formulation that all agents know 
the true prior probability po — V{H — ho) with the setting 
where each Agent i bases its decision rule on qi{po), where qi 
a scalar quantizer on [0, 1]. Such a setting can arise when the 
team faces an ensemble of binary hypothesis testing problems 
and the agents lack the ability to have a different decision rule 
for each problem. The prior probability po is thus modeled as a 
realization of a random variable Po with density function fpg . 
This section discusses computation of Bayes risk averaged 
over Po and the optimization of the quantizers applied to the 
prior probability. 
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In order to maximize team performance, all agents must 
coordinate by sharing their quantized prior probabilities. The 
following steps describe the collaborative decision making 
process. 

1) Quantizer design: The if -level quantizers 51 , . . . , g^r are 
designed. These quantizers remain fixed for all time. 

2) Coordination: Agents encounter an object whose prior 
probability is po- Each agent applies its quantizer to the 
prior probability and sends the output qi{po) to all other 
agents as a part of collaboration. 

3) Decision rule design: Agents design the best common 
decision rule based on qi{po), . . . ,q]y{po). 

4) Signal observation and decision making: Each agent 
observes a noisy signal and applies the decision rule 
to make a local decision Hi. 

5) Decision fusion: All local decisions Hi are fused to 
produce a global decision H. 

Quantizer design and decision rule design are detailed in this 
section. The operations of local decision making and global 
decision fusion have already been discussed. Coordination 
simply involves communication. 

The Bayes risk incurred when each agent bases its lo- 
cal decision on its quantized prior probability is denoted 
-Rm(9i(po)j • ■ • J 'ZAflPo))}^ This is called mismatched Bayes 
risk to contrast to the true Bayes risk R{po) if the agents 
know the true prior probability po. The Bayes risk error is 
defined as 

d{po,qi{pQ), ■ ■ ■,qN{po)) = i?M(gi(po), ■ • ■,qN{po))-R{po)- 

We compute the mean Bayes risk error (MBRE) as the distor- 
tion of the quantizers for prior probabilities, which measures 
the average performance over all pq: 

D = E[d{Po,qiiPo),...,qNiPo)] 

= / d{po,qi{po),...,qN{po))fPoiPa)dpo- 
Jo 

Minimum MBRE quantizers are to be designed within this 
model. 

A. Single Agent 

Let us first review the case of = 1 Q. The optimal choice 
of K values for quantized prior probabilities is described by 
the minimum MBRE quantizer 

ql = argmmE[d{Po,qi{Po))], 
91 

where the distortion measure of the single quantizer qi is the 
Bayes risk error 

d{po,qi{pQ)) = i?Af(gi(po)) - R{Po) 
= pocioPoPhiniPQ)) + (1 - PQ)coiPE{qi{Po)) 
-PoCioPe{pq) - (1 - PQ)colPE{PQ)■ 
Theorem 1: ||4] Thm. 1] The Bayes risk error d{pQ,a) is 
nonnegative and only equal to zero when pq = a. As a function 
of Po G (0, 1), it is continuous and strictly convex for all a. 

'Note that by coordination, eacli agent knows otlier agents' quantized prior 
probabilities. 



Theorem 2: Q Thm. 2] For any deterministic Ukelihood 
ratio test H{-), as a function of a e (0, 1) for all po, the Bayes 
risk error d{pQ,a) has exactly one stationary point, which is 
a minimum. 

Due to the strict convexity of d{po,a) in po for all a, 
quantizers that satisfy necessary conditions for MBRE opti- 
mality are regular; quantization cells are subintervals TZi = 
[0,5l),7^2 = [bi,b2),. ■ ■ ,TZk = and each repre- 

sentation point flfc is in TZk- The necessary conditions for the 
optimality of a quantizer for fp„{Po) are now described. 

A nearest neighbor condition describes an expression for 
the cell boundaries {bk} for fixed representation points {0^}. 
Between two consecutive representation points ak and ak+i, 
the cell boundary 6^. needs to separate xi such that d{xi ,ak)< 
d{xi, ai^^i) and X2 such that d{x2,ak) > d{x2,ak^i). Thus, 
bk = b* is obtained from the condition 

dib*,ak)^d{b*,ak+i). (5) 

The point is found to be 

CQi {PE{ak+i) - PBM) 

coi {PEiak+i) - PBiak)) - cio (-Pi(afe+i) - Ph{ak)) ' 

A centroid condition describes optimal representation points 
for fixed quantization cells. The MBRE is expressed as the sum 
of integrals over quantization regions 

K 

^ = X! / '^^P°' 0.k)fPa (Po) dpo, 
k=iJn, 

and the minimization may be performed for each cell sepa- 
rately. The representation point ak = a* of the cell TZk is 
chosen from the optimization problem 

a* = arg min <^ / d{po, a)fp„ (po) dpo \ ■ 

a. iJTlk J 

Since Bayes risk error is a Bregman divergence |3|, the unique 
minimizer is the centroid of the region TZk- 

Sn^PafpQ{po)dpo 

(X ~ — . 

IlZ^fPaiPo)dpQ 

The minimum MBRE quantizer ql can be found by the 
iterative Lloyd-Max algorithm, which alternates between the 
nearest neighbor and the centroid conditions. 

B. Identical Quantizers 

Consider, for iV > 1, that all agents use the same quantizer 
q for prior probabilities; coordination informs all agents of the 
identicality. For an object with prior probability po, all agents 
use p' = q{po) as the object's prior. The agents will incur the 
mismatched Bayes risk 

Rm - PoCioPh + (1 - Pa)coiPE (6) 

due to their decisions, but what they minimize is perceived 
Bayes risk: 

Rp = p'cioPh + (1 - p'^oiPE- (7) 

The probabilities Pj^ and P|J in (j6| and (jTji are identical. In 
other words, P^^ and P^ are determined from the decision 



4 



QUANTIZATION OF PRIOR PROBABILITIES FOR COLLABORATIVE DISTRIBUTED HYPOTHESIS TESTING 



rules that minimize the perceived Bayes risk (|7]i and applied 
to compute the mismatched Bayes risk (j6]). 

A general way to find local decision rules is to directly 
optimize ([T]i and (|2]i, but these are generally complicated 
functions. One way to simplify the analysis for additive 
observation noise models is to find a decision-making model 
with a single agent whose performance is the same as the team 
of the multiple agents. By the same performance, we mean that 
the single agent uses the same optimal decision rule and its 
Type I and Type II error probabilities are respectively equal 
to P|; and Pj^ when it uses the same quantizer q for prior 
probabilities. 

Theorem 3: Assume that the unquantized prior proba- 
bility is known. Consider N agents that perform group 
decision-making with observations corrupted by additive 
noises Wi,...,Wn- For convenience, index the agents in 
descending order of the realizations of the noises: > 
W(^2) > • • • > W(N) ■ When their decisions are fused by the 
L-out-of-A^ rule, their performance is the same as that of a 
single agent having the same Bayes costs if its observation is 
corrupted by the Lth largest additive noise V = W(^i^y 

Proof: The global decision is the same as the decision of 
Agent L because all agents adopt the same decision threshold 
A. If Agent L declares /ig, then Agents L + 1, . . . , N, whose 
observations are smaller than or the same as that of Agent L, 
also declare ho. Since at least N — L + 1 agents send ho, the 
fusion rule gives ho as the global decision. If Agent L declares 
hi, then Agents 1, . . . ,i — 1, whose observations are larger 
than or at least the same as that of Agent L, also declare hi 
and the global decision is hi. 

As such, the Bayes risk ([3]l can be rewritten as 

R = PoCioPh + {I - Po)coiPM 

= PoCioP(W^(L) +so>X\H = hQ) 

+ {l-po)coiV{W^L)+si<X\H = hi). (8) 

If we consider a new single-agent problem with additive noise 
V = ^{L), then the Bayes risk of the single agent is equal 
to (|8]l. Therefore, the optimal decision rule of the single agent 
is equal to that of the multiple agents, and the single agent 
obtains the same performance as the team of multiple agents. 



When the Wi are iid continuous random variables with pdf 
fw and cdf Fw, the random variable V = Wi^^ is well 
understood from the theory of order statistics y_6J. The pdf 
of V is 



fv{v) 



m 



(v) [l-Fwivt-'fwiv) 



{N-Ly.{L-iy. ^ 



Thus, we only need to consider a single agent with a different 
additive noise V, no matter how many agents there are. The 
Bayesian decision rule of the single agent that observes Y = 
Sm + ^ is given by 



fY\Hiy\hi) ^ fv{y-si) 

fY\H{y\ho) fv{y 



H(y)=hi 

> 

So) - < (1 

H(y)=ho ^ 



PqCio 



which can also be used by the multiple agents. 

Theorem 4: If multiple agents use identical quantizers for 
prior probabilities, then their optimal quantizer is equal to the 
optimal quantizer in the equivalent single-agent model. 

Proof: Since Theorem [3] is valid for any prior probability. 
Theorem [3] holds for quantized prior probabilities whenever 
the multiple agents and the single agent quantize the prior 
probability to the same value. Thus, their average perfor- 
mances are also the same if they use the same quantizer q 
for prior probability. As a result, the single agent can achieve 
the minimum MBRE by adopting the optimal quantizer of the 
multiple agents and vice versa. ■ 

The analysis and design of the minimum MBRE quantizer 
in a single-agent model in f4l can be applied to the multiple- 
agent model without any change except the noise model. 



C. Diverse Quantizers 

Now consider the setting where each agent may have its 
own quantizer for prior probabilities. For an object with prior 
probability po. Agent i believes that the probability of the 
object being in state ho is p^'^ = qi{po), which may be 
different from Agent j's quantization p'^^^ = QjiPo)- This 
diversity may allow the agents to improve the quality of their 
decisions as a team. 

In order to take advantage of diversity, the agents need to 
collaborate in their decision making. The coordination phase 
of the collaborative decision making process is key. When 
agents use identical quantizers, all agents consider the same 
perceived Bayes risk (|7]) even if they do not communicate, but 
here collaboration must be established. 

Agents may try to minimize their own perceived Bayes risks 
so as to give the best decisions for all agents. When all agents 
quantize the prior probability to different values, however, they 
have different perceived Bayes risks: 

i?W = pWcioPl; + (l -P'^^) coiPE + 4'^ 

If all agents individually optimize their decision rules, the 
resulting performance is not as good as their best [^. 

All agents will incur the same cost as a result of their 
decisions: ciq if their team misreads ho as hi and cqi if their 
team misreads hi as ho. This motivates them to collaborate by 
sharing a common goal that replaces their individual perceived 
Bayes risks. As the common goal, we introduce a weighted 
sum of the perceived Bayes risks called perceived common 
risk: 

N 



1=1 



where Ui are constants that satisfy J^iLi Ui = 1 and Ui > 
for all ie[N]. 

The introduction of the perceived common risk allows 
us to treat identical-quantizer and diverse-quantizer settings 
on a common footing. The minimum perceived-common-risk 
decision rule can be used since, if all agents use identical 



Po)coi 



quantizers like in Section III-B their perceived common risk 
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Fig. 1. An example that shows how the dependency among representation 
points propagates to break the independence between representation points of 
two different cells Ti-w and Ti-vi. 



is equal to their perceived Bayes risks: 

N 

RPC = ^U,(p(')cioPl;+(l-p('')coiPlJ 
i=l 
N 

= ^^/,(p'cio/'i; + (l-p')coiPlJ) 

i=l 

= p'cioPh + {l-p')coiPE = Rp. 

It may seem unintuitive to use the perceived common risk as 
a criterion of decision making because decision rules, which 
are determined based on the perceived common risk, may not 
be optimal for some prior probability pq. However, it is the 
Bayes risk averaged over Pq that measures the performance of 
the team. Thus, a set of quantizers that leads to good decisions 
on average is essential for the agents to use the perceived 
common risk as a common goal of minimization. 

Design of such quantizers has high computational complex- 



ity. In Section III-B a single quantizer is easily designed by 
the iterative Lloyd-Max algorithm, which utilizes indepen- 
dence among endpoints of quantization cells in the nearest 
neighbor step (optimizing cell boundaries) and independence 
among representation points in the centroid step (optimizing 
representation points). On the other hand, multiple quantizers 
that define different quantization cells do not have such 
independencies. 

For the simple example of Fig. [T] the cell Tl2i of the 
quantizer (72 affects the decisions for objects whose prior 
probabilities are within the interval Ci or C2. The team 
performance in the interval Ci is affected by the representation 
points a'"i^ and a^^' and by a^2^ 



and a^^' in the interval C2. 



Hence, we can observe that dependency is propagated through 
the representation points: a choice of a'^^ depends on a choice 
of a^^"*, which depends on a choice of a'lK In order to avoid 
such complexity, we introduce an indirect method to optimize 
diverse quantizers. 

Consider a team of N agents that respectively use different 
K-level quantizers gi, . . . , g^r and another team of N agents 
that all use an identical _ft'5-level quantizer qs- 

Theorem 5: A set of N different X-level quantizers 
{qi, . . . , q^} and a ii's-level quantizer qs result in the same 



perceived common risk if, for all po G [0, 1], 



N 

E 

i=l 



Uiqiipo) = qsiPo) 



(9) 



Proof: For an object with prior probability po, agents 
respectively using {gi, . . . , qyv} make decisions based on 
individually quantized prior probabilities p'*' ~ qi{po)- Their 
perceived common risk is: 




(p«CioPl;+(l-p«)coiPi;^) 

CwPh+(j2u,{l-/^^)jcoiPB. 



(10) 

For agents using the common quantizer qs, with quantized 
prior probability p' = qs{Po), their perceived common risk is 



i?pc,2 = p'cioPh + (1 - p')coiPE- 



(11) 



The perceived common risks ([TOjl and ( [TT] i only depend on 
the decision rules used by N agents. If there exists a constant 
t that satisfies 

Rpc,i — t ■ Rpc.2 

for any A^-tuple of decision rules, then the A'^-tuple that 
minimizes -Rpc,i also minimizes i?pc,2- If the proportionality 
property holds for all po G [0, 1], then the agents in both 
cases always use the same decision rules. Therefore, the set 
of different quantizers {gi, . . . , gjv} and the set of identical 
quantizers {qs, ■ ■ ■ , qs} will cause the same Bayes risk on 
any problem in the ensemble. 

For any A^-tuple and any pq, i?pc,i = t-Rpc.2 if and only if 
Eti u^P^"^ = ¥ and u, (1 - - 1(1 - p'). From 

the fact that X^iLi ""i — 1' the constant t can only be 1, and 
the condition is simplified to 



N 

E 

i=i 



Uiqiipo) = qsipo) 



for all Po e [0,1]. 



This simple condition comes from the fact that the perceived 
common risk is a weighted sum of the perceived Bayes risks. 

■ 

Theorem 6: A team of N agents individually using N 
diverse iiT-level quantizers can achieve the minimum mean 
Bayes risk error that they can achieve when they use the same 
{N{K - 1) + l)-level quantizer. 

Proof: When the agents use an identical if 5 -level quan- 
tizer, the optimal quantizer 175 is always a regular quantizer Q; 
each quantization cell Ck is an interval and its representation 
point Xk is within the interval. For each cell Ck of 175, 
k = 1, . . . , Ks, the condition ^ is expressed by an equation 



N 



Xk 



E« 



where a'*) is one of the representation points of ii'-level 
quantizer g;, i = 1, . . . ,N. Overall, we have a total of ^5 
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equations, which are described in the following matrix form: 



(12) 



Xi 




Ml 




= A 




_ XKs 




_ UN _ 



where A is a Ks x N matrix that has 



(1) (2) 



AN) 



'■kj2 "fejJV 

as its jth row and is the representation point of the kjith 
cell of qi for any 1 < kji < K. 



There exists an A that satisfies (12 1 if and only if there 
exists a set of N different X-level quantizers qi, . . . ,qN that 
are equivalent to qs- In ( 12 1, the vector [ui U2 ■ ■ ■ u^]'^ is a 
given parameter and the vector [xi X2 ■ ■ ■ xks]'^ is uniquely 
determined by the optimization of qs', the matrix A consists 
of unknown parameters (i.e., representation points of q.^) to be 
determined. However, if A has any linearly dependent row, 
the representation points may not exist. On the other hand, if 
A has only linearly independent rows and Ks < NK, then 
we can solve ( [T2| to find all the representation points of qi. 

The maximum number of linearly independent rows of A 
is N{K - 1) + 1; 



(1) 

1 




• 4"^^ 1 


(1) 

2 






(1) 
1 


(2) 

Co 





(1) (2) 
"(I)" """"(2)" 
,(1) „(2) 



,(1) „(2) 



(N) 
1 



a 



AN) 



"(i)"""""(2)" 

(1) (2) 
^1 '^N 



a 



,(1) „(2) 



(1) A2) 



a 



AN) 

'■N 



AN) 



is a linear combination 



Any other row 

of the N{K — 1) + 1 rows. Thus, the existence of {qi , . . . ,qN} 
that is equivalent to qs is only guaranteed when K < Ks < 
N{K-1) + 1. 

A quantizer with greater Ks does not increase mean Bayes 
risk error |4|. Therefore, the minimum mean Bayes risk error 
of agents using diverse if -level quantizers is upper bounded 
by that of agents using the identical {N{K — 1) + 1) -level 
quantizer. ■ 

The optimal set of if -level quantizers for N agents is always 
a set of diverse quantizers if K > 1. The optimal set of 
quantizers can be designed by a two-step algorithm. The first 
step is to design the optimal {N {K — 1) + l)-leYel quantizer qs 
to be commonly used by N agents, e.g. with the Lloyd-Max 
algorithm |4|. 

The second step is to disassemble the quantizer qs into N 
different if -level quantizers qi, . . . ,qN that lead to the same 



mean Bayes risk. For convenience, we consider the if -level 
quantizers whose quantization cells are intervals, i.e., the cell 
TZik is defined to be [b^-i, b^) for any Agent i and 1 < k < K. 

In order to satisfy (j9]l, each cell boundary of qs needs to 
be a cell boundary of at least one of qi, . . . ,qN because, for 
any cell boundary y of qs and for any xi < y and X2 > y, 

= qs{xi) 7^ qs{x2) = Eili "»%(2;2)- Also, 

any two or more quantizers out of qi, . . . ,qN cannot have a 
common cell boundary since qs has N{K — 1) + 1 cells. As 
a result, each cell boundary of qs, except and 1, needs to 
be a cell boundary of exactly one of qi, . . . , g^r. 

Therefore, we determine cell boundaries of gi, . . . ,gjv by 
splitting the cell boundaries of qs into N sets by the following 
conditions: 

N 



U B, = Bs, 



i=l 



B, n Bj = {0, 1}, for all i and all j ^ i, 



(13) 



where Bs is the set of cell boundaries of qs and Bi are the 
sets of cell boundaries of q^ \Bs\ — N{K — 1) + 2 and 
|i?i| = if + 1. The sets Bi,. .. ,Bn that satisfy ([bIi are not 
unique. 

Representation points of the cells of qi , . . . , g^r are deter- 
mined after cell boundaries of the quantizers are fixed. We 
have Ks = N{K — 1) + 1 equations of representation points 
of qi, . . . ,qN that describe the condition (|9]l. Once we find 
the representation points that satisfy all the equations, then 
the quantizers are minimum MBRE diverse quantizers for the 
N agents. The optimal identical quantizer qs is always regular 
because the optimal quantizer for single agent is regular, but 
the optimal diverse quantizers qi, . . . ,qpf need not be regular 

The total number of the representation points is A^if , but 
we have iV — 1 less equations than what we need to uniquely 
determine the representation points. Furthermore, a different 
arrangement of cell boundaries changes the equations and, 
consequently, proper representation points. Therefore, optimal 
diverse if -level quantizers are not unique; any choice leads to 
the same result because Theorem |5] shows that any set of the 
optimal quantizers causes the same mean Bayes risk error as 
qs does. 

D. Comparison to Team-Oblivious Agents 

We have discussed teams of agents that are aware of the 
existence of the other — 1 agents and the L-out-of-A^ 
fusion rule. Let us now consider the case when the agents 
do not know N and L; individual agents maximize their own 
probability of being correct. Agent i considers the Bayes risk 

R = PoCioPl^ + (1 - Po)caiPl^^- 

All agents choose their quantizers as if they are single agents 
with additive noise W drawn from fw- Consequently, they 
have identical quantizers q because they have the same Bayes 
costs cio and cqi. 



Their quantizers are obviously not optimal. In Section III-B 



it has been shown that their optimal identical quantizers need 



to be designed based on the additive noise V 



W, 
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whose density function is different from fw, in a single-agent 
model. Furthermore, any identical quantizers can be improved 



by transformation of diverse quantizers, as in Section III-C 



Therefore, for each agent, minimization of the MERE of its 
own decision is not the best strategy as an optimal team 
member and its optimal behavior depends on N and L. The 
effect of and L on the design of optimal quantizers is 
reflected by the equivalent single-agent model in Theorem [3] 



0.2 0.4 0.6 O.S 




IV. Examples 

Throughout this section, assume that the prior probability 
Po of an object being in state Hq is drawn from the uniform 
distribution /po(po) = 1 for all po G [0, 1]. 

A. Gaussian Likelihoods, MAJORITY Rule 

Suppose the object sends the signal sq = in state Hq and 
si = 1 in state hi, and each agent receives the signal corrupted 
by additive iid noise Wi with cdf F\y and pdf fw where 

1 



fw{w) 



V2t 



Each likelihood fY,\H is thus Gaussian with mean H. The 
MAJORITY rule is used to fuse local decisions made by N 
agents. We assume that N is an odd number so that voting 
never results in a tie. 

From Theorem [3] the equivalent single-agent model has an 
additive noise V^'^^ with pdf given by 

N\ 



The mean of V^" is zero and the variance of Vr 



N 



proportional to that of Wi'. 

var(y^-) 

oo 



iV! 



""'j^Z^^w' iv)[l~ Fwiv)Y'^' fw{v)dv 

]\J\ N~l N-1 

y'j^z^p^' (^)[i-^v(^)] ^ fwiv)dv 



Nl 



N > 



(14) 



where /aa and Fj^; denote the pdf and cdf of a standard normal 
random variable, and z = vja. The factor is the variance 
of the median of N iid standard normal random variables. The 
means and variances of Gaussian order statistics have been 



studied extensively 117|-|19|, and the value of C/J for any 



1 < TV < 20 can be found in fTs). For example, C^^' = 0.4487 
and C""' = 0.2863. 

This equivalent single-agent model is considered for opti- 
mization of identical {N{K — 1) + l)-level quantizers. An 
optimal set of diverse A'-level quantizers for the agents can 
be designed from the optimal {N{K — 1) + l)-level quantizer 

Fig. [2] shows an example of a team of five agent^ it depicts 
an optimal set of diverse ii'-level quantizers and the resulting 

^An example of a team of three agents is given in j6j. 



(a) K = 1 



(b) K = 2 





(c) K = 3 



(d) K = A 



Fig. 2. Optimal diverse K-\eve\ quantizers (cell boundaries as +'s and 
representation points as o's) for uniformly distributed Pq and the resulting 
mismatched Bayes risk when N = 5 agents perform distributed hypoth- 
esis testing fused by the MAJORITY rule. The parameters are defined as 
cio = CQi = 1, (T = 1, and Ui = 1/5, for i = 1, . . . , 5. For comparison, 
the unquantized Bayes risk curve is depicted in gray in (a) and (b). 



Bayes risk for K = 1, ... ,4. The Bayes risk error due to 
quantization of prior probabilities is depicted in Fig. [3] which 
shows improvement of decision making as K increases. Also, 
the mean Bayes risk error is given in Fig. [4j it shows the 
advantage of using optimal diverse quantizers against using 
optimal identical quantizers. 

Asymptotically, decays inversely with N; more pre- 
cisely | |20j , 

^ (15) 



lim iV-Cr' 



If the agents could share their observations rather than their 
local hard decisions, the team would base its decision on the 
sample mean of the observations. The resulting performance 
is governed by the variance of the sample mean of the noise 
variables Wi, . . . , Wn- For cr — 1, 



lim N ■ var 



N- 



w,. = 1. 



The ratio of 7r/2 between the two asymptotic variances quan- 
tifies the loss in using majority vote rather than fusing full 
measurements. 



g 



QUANTIZATION OF PRIOR PROBABILITIES FOR COLLABORATIVE DISTRIBUTED HYPOTHESIS TESTING 



0.2 0.4 0.6 

(a) K = 1 



0.5 
P. 



{b)K: 




0.2 0.4 0.6 0.8 1 0.2 0.4 0.6 0.8 1 



(a) K = 1 



(h) K = 2 



JIAAA A, A.A/\ AAA/ 



■./\--\-^A^AA/ 



0.5 
P. 



0.5 
P. 



(c) K = 3 (d) K : 

Fig. 3. Bayes risk error of the quantizers in Fig. |2] 




Fig. 4. Mean Bayes risk error for uniforinly distributed Pq in tlie example 
of Fig. [2] 



B. Gaussian Likelihoods, OR Rule 

Maintaining the Gaussian observation model from Sec- 



tion IV-A now consider fusion using the OR rule: the global 
decision is ho only when all agents declare /iq. The equivalent 
single-agent model has an additive noise V^'^, which is the 
maximum order statistic of noises Wi, . . . , W^. The pdf of 
V^"* is given by 



The mean of V^"* 



and the variance of V^"* 



fv°^<v)^NF^-\v)fw{v). 
is proportional to a, 
E[y-] = . a, 

is proportional to a^, 

var(^°^) = 



these can be proven analogously to ( 14 1. The factor ii'^ is 





(c)K- 



(d)K: 



increasing in N but is decreasing in A^. For example, 



Fig. 5. Optiinal diverse iC-level quantizers (cell boundaries as +'s and 
representation points as o's) for uniformly distributed Pq and the resulting 
mismatched Bayes risk when N = 5 agents perform distributed hypothesis 
testing fused by the OR rule. The parameters are defined as cio = cqi = 1, 
a = I, and Ui = 1/5, for i = 1, . . . , 5. For comparison, the unquantized 
Bayes risk curve is depicted in gray in (a) and (b). 



Aig"* = 0.8463 and /ig'* = 1.1630; Cr = 0-5595 and C""* = 
0.4475. For other N between 1 and 20, the values of /i^ and 
C^" are hsted in |[T8). 

An optimal set of diverse K-level quantizers for a team 
of five agents is given in Fig. |5] for K = 1, ... ,4. Fig. |6] 
and Fig. |7] show the Bayes risk error and the mean Bayes 
risk error due to the quantization. The trends are similar 
to those in Section |IV-A| which considers the same model 
except for the fusion rule. The difference in the fusion rule 
changes the equivalent single-agent model. However, the same 
optimization algorithm of quantizers for prior probabilities 
can be applied in any case: designing the optimal identical 
{N{K — 1) + 1) -level quantizer of the equivalent single 
agent and disassembling the quantizer into A^ diverse K- 
level quantizers. The algorithm comes from the relationship 
between the perceived Bayes risk and the common risk, which 
is defined as the weighted sum of the perceived Bayes risk. 
Thus, the algorithm does not depend on how the team of agents 
make decisions and the error probabilities and P|J are 
computed. 

Average performance with the or rule (Fig. |7]) is slightly 
worse than with the MAJORITY rule (Fig. |4]i. A quaUtative 
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(a) K = 1 




{b)K: 




Fig. 



(a) MAJORITY rule 



(b) OR rule 



8. Optimal decision threshold for N agents for cio = cqi = 1 and 
1. 



JvaAAAAAaaaa. 



0.5 
P. 



j Ka/\/\/x/\/X/\A/\AAAAA/- 

0.5 
P. 



(c) K = 3 (d) K = 4: 

Fig. 6. Bayes risk error of the quantizers in Fig. |5] 




Fig. 7. Mean Bayes risk error for uniformly distributed Pq in the example 
of Fig. [5] 



understanding can be obtained through study of V^"* and V^^^ 
and asymptotic behavior of the variances of these random 
variables suggests that the performance gap increases with N. 

While the mean of V^*^ is zero for all N, ii'^ (the mean 
of V^"*) is positive for iV > 2 and increasing with A^. In the 
equivalent single-agent model under the OR rule, the single 
agent tends to observe something larger than a true signal 
by about /i^ because of the noise V^'^. Hence, the optimal 
decision threshold of the single agent is larger than that in 



the model of Section IV-A This can be interpreted as any 
individual agent optimally requiring "stronger evidence" to 
declare hi as the number of agents increases. The optimal 
decision thresholds for = 5 are shown in Fig. |8] The 
asymptotic growth of /i^ is given by (see |16| Ex. 10.5.3]) 



N 



lim ^^7(21ogAr)i/2 = l. 



If all the equivalent noise variables had the same standard- 



ized distribution, then MAJORITY and OR fusion rules for fixed 
N could be compared through the variances C^^' and (^'^. We 



saw in ^ that = e(l/A^). The decay of C^" is much 
slower; specifically (see p6| Ex. 10.5.3]), 



N 



lim (illogAf).^''^!. 



This suggests that for large N (and the Gaussian likelihood 
case), the majority rule is more effective than the OR rule. 



C. Exponential Likelihoods 

Consider a particle that disappears with rate Sq in state /iq 
and with rate si in state hi, where sq > si. Conditioned on 
H, the particle has an exponentially-distributed lifetime Y: 

fY\H{y I Kn) = SmC"'''"^. 

An agent observes that the particle disappears at time Y = y 
and performs Bayesian hypothesis testing by the likelihood 
ratio test: 



fY\H{y\hi) ^s."' 

fY\H{y\ho) 



< 

H=ho 



PqCio 
(1 -po)coi 



The likelihood ratio test can be simpUfied to the decision rule 
1 



H=hi 

y I 

H=ho 



So - Si 



log 



So Pocio 



^si (1 -_po)coi 
which yields errors with probabiUties 



pi ^ g-^oA 



and 



= 1 - e 



= A, 



Now suppose that N agents perform Bayesian hypothesis 
testing with TV particles in the same state; Agent i observes 
that the ith particle disappears at time Yi — yi and applies a 
common decision threshold A to its observation to make its 
local decision. All agents' decisions are fused by L-out-of-A^ 
rule. Then the equivalent single-agent model is to consider a 
particle with lifetime ^(l), which is the Lth longest lifetime 
among {Yi, . . ■ ,Yn}, 



hra) 



(1 
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QUANTIZATION OF PRIOR PROBABILITIES FOR COLLABORATIVE DISTRIBUTED HYPOTHESIS TESTING 




(a) 



Fig. 9. Bayes risk (a) without quantization of prior probabilities and (b) with 
diverse 2-level minimum MERE quantizers for N = 5, sq = 2, si = 1, 
ciO = coi = 1> and Ui = 1/5 for i = 1, . . . ,5 



The probabilities of global errors are 



Pe = 



N 

E 

n=M 



(e^'"'^)"(l 



N 



pll _ 



E 



N 



'SoX\N—n 



1(1 - e-''i^")"(e-^i^)^- 

\ //, / 

n=N-M+l 

In this scenario, a small i is a good choice for the fusion 



rule. Fig. 9a shows that the smallest mean Bayes risk without 
quantization of prior probabilities is achieved hy L = 1. 
Fig. |9b] depicts an example of Bayes risk when five agents 
use diverse minimum MBRE quantizers and their fusion rule 
is the OR rule or the MAJORITY rule. 

V. MiNiMAX Bayes Risk Error Quantizers 

Rather than mean Bayes risk error, let us consider maximum 
Bayes risk error as the criterion for optimizing quantizer 
design |5|. Such quantizers maximize worst case performance, 
whereas minimum MBRE quantizers maximize average per- 
formance. The minimax Bayes risk error quantizer is defined 
by the following optimization problem: 

{ql, • ■ ■ , to) = argmin maxd(po, 9i(po), ■ ■ . ,gAr(po)). 

(91,. ..,?«) P« 

The minimax Bayes risk error quantizer has the same near- 
est neighbor condition as the minimum MBRE quantizer for 

= 1. On the other hand, a centroid condition for optimality 
of a regular quantizer for = 1 is different from that of the 
minimum MBRE quantizer |j5|. For any quantization point a, 
the Bayes risk error d{pQ, a) = Rm{o,) — R{po) is nonnegative 
and strictly convex in po, with minimum value of zero attained 
only at po — o.- Thus, its maximum point within its fcth cell 
T^k = [^fc-ii ^fc) is a cell boundary: b^^i or b^- The point a* 
that satisfies 

d{bk-i,a*)=d{bk,a*) (16) 

minimizes the maximum Bayes risk error within TZk- This is 
the centroid condition for the representation point a/j = a* of 
cell TZk- The minimax Bayes risk error quantizer can be found 
by alternatively applying the nearest neighbor condition (jSj) 
and the centroid condition ( 16 1 through the iterative Lloyd- 
Max algorithm. 

For iV > 1, agents can take advantage of diversity in the 




0.5 
P. 



(a) Bayes risk 



(b) Bayes risk en'or 



Fig. 10. (a) Bayes risk and (b) Bayes risk error for N = 5 agents performing 
distributed hypothesis testing fused by the MAJORITY rule. They observe 
signals corrupted by iid additive Gaussian noise A/^{0, cr^). The pai'ameters 
are defined as sq = 0, si = 1, cio = cqi = 1, o" = 1, and Ui = 1/5 for 
i = 1,...,5. 



the L-out-of-iV fusion rule is equivalent to a single agent with 
noise equal to their Lth largest noise W^(l) (cf- Theorem [3jl. 
Thus, identical quantizers that minimize maximum Bayes risk 
error of the N agents also minimize that of the single agent 
and vice versa (cf. Theorem |4|. 

Furthermore, if the N agents collaborate by sharing the 
perceived common risk, there exists a set of N diverse K- 
level quantizer that leads to the same Bayes risk for any pq 
as a set of identical {N{K — 1) + l)-level quantizers does (cf. 
Theorem |5j. Therefore, the identical {N{K — 1) + l)-level 
minimax Bayes risk error quantizers can be transformed into 
N diverse ii'-level minimax Bayes risk error quantizers (cf. 
Theorem [6]). 

Fig. [To] shows an example of Bayes risk when five agents 
use diverse 2-level minimax Bayes risk error quantizers and 
their fusion rule is MAJORITY. A property of minimax Bayes 
risk error quantizers is that the maximum Bayes risk errors at 
all cell boundaries are the same, which is shown in Fig. 10b 



same way as in Section III-C A team of N agents bonded by 



In addition, the minimax Bayes risk error quantizers are not 
dependent on the distribution of Pq as long as fpgipo) > 
for all Pq G [0, 1] because they minimize the worst case error, 
not the average. 

VI. Conclusion 

We have discussed distributed detection and data fusion 
performed by a team of agents when there is a distribution 
of prior probabilities and the agents only know quantized 
versions of prior probabilities. We have focused on how to take 
advantage of diversity in quantization. When all agents use 
identical quantizers, they are affected by the same perceived 
Bayes risk and the distributed hypothesis testing problem can 
be analyzed by existing theorems of decision theory. On the 
contrary, when they do not use identical quantizers, then they 
consider different perceived Bayes risks, which prevents them 
from collaborating in hypothesis testing. We let the agents 
use the perceived common risk as a new distortion measure 
of hypothesis testing so as to unite them as a team to perform 
distributed hypothesis testing in any case. 

We have defined mean Bayes risk error as the optimization 
criterion for prior-probability quantizers. We have presented 
theorems to show that diverse quantizers are better than 
identical quantizers. The equivalence between multiple-agent 
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decision making and single-agent decision making simplifies 
a team of agents that use identical quantizers to a single agent. 
By combining the equivalence theorem with the equivalence 
between diverse quantizers and identical quantizers used by 
a team of agents, we can take advantage of the study of 
the minimum MBRE quantizer of a single agent to analyze 
optimal diverse quantization for multiple agents. It is shown 
that if the agents use diverse K-leyel quantizers, it has the 
same effect of using identical {N{K-l) + l)-level quantizers. 

The equivalence theorems hold under the condition that 
all agents collaborate to perform Bayesian hypothesis testing. 
Hence, for any given distortion function of quantizers, diverse 
quantizers that minimize the distortion can be easily found. 
While the case of minimum MBRE was covered in detail, we 
also discussed the minimax Bayes risk error criterion. In the 
minimax case, one can again first design an (N{K — 1) + 1)- 
level quantizer for a single agent and then disassemble the 
quantizer into N diverse ii'-level quantizers. 
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